Display device supporting configurable resolution regions

ABSTRACT

A virtual reality system and a display device that can be used, for example, as part of the virtual reality system. The display device can have more than one data driver, such as an even row data driver and an odd row data driver. The display device can have a configurable resolution such that one region of the display device operates at full resolution while another region of the display device operates at a reduced resolution. The virtual reality system can also track an eye gaze and adjust the full resolution region of the display device to track the eye gaze.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application claims priority from U.S. Provisional PatentApplication No. 62/131,705, filed on Mar. 11, 2015, the contents ofwhich are incorporated by reference herein in their entirety.

BACKGROUND

The present disclosure generally relates to virtual reality systems anddisplay operation in a virtual reality system.

Electronic displays include a plurality of pixels, which may eachinclude a plurality of sub-pixels (e.g., a red sub-pixel, a greensub-pixel, etc.). Most displays are designed for use with cellphones,tablets and televisions. However, the characteristics of most displaysare not ideal for use in a virtual reality (VR) headset whereperformance requirements (e.g. resolution and refresh rate) are morestringent than in typical displays.

SUMMARY

In one embodiment, a display device comprises a display screen. Thedisplay screen includes a first pixel row of first pixels havingrespective storage capacitors, the first pixels connected to a firstscan line, a second pixel row of second pixels having respective storagecapacitors, the second pixels connected to a second scan line, firstdata lines connected to the first pixel row, and second data linesconnected to the second pixel row. Additionally, a first data drivercircuit drives the first pixel row via the first data lines. A seconddata driver circuit drives the second pixel row via the second datalines.

In one embodiment, a display device comprises a display screen having aplurality of pixels organized into pixel columns and pixel rows. Aresolution circuit stores resolution configuration data indicative of alocation of a first region of the display screen operating in reducedresolution and indicative of a location of a second region of thedisplay screen operating in full resolution. A selective scaling circuitreceives image data and processes the image data based on the resolutionconfiguration data, the selective scaling circuit upscaling a firstportion of the image data for the first region of the display screen andnot upscaling a second portion of the image data for the second regionof the display screen.

In one embodiment, a virtual reality system, comprises a virtual realityheadset. The headset comprises a display having a first region operatingin reduced resolution and a second region operating in full resolution.The headset also comprises an eye tracking sensor to generate gaze dataindicative of a gaze direction of the eye. The virtual reality systemadjusts a location of the second region operating in full resolutionbased on the gaze direction of the eye.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a virtual reality system environment,according to an embodiment.

FIG. 2A is a wire diagram of a virtual reality headset, in accordancewith an embodiment.

FIG. 2B is a cross section of the front rigid body of the embodiment ofa VR headset shown in FIG. 2A.

FIG. 3 is an electronic display with dual row drivers, according to anembodiment.

FIG. 3A is the display from FIG. 3 where only the odd pixel rows areillustrated, according to an embodiment.

FIG. 3B is the display from FIG. 3 where only the even pixel rows areillustrated, according to an embodiment.

FIG. 4 is circuit diagram of a pixel P, according to an embodiment.

FIG. 5 is a timing diagram illustrating operation of the scan driver anddata drivers, according to an embodiment.

FIG. 6A is a diagram illustrating a display screen, according to anembodiment.

FIG. 6B is a diagram illustrating a display screen with configurableeffective resolution.

FIG. 7 illustrates a timing controller and data drivers supportingconfigurable effective resolution, according to an embodiment.

FIG. 8A illustrates selective scaling circuitry supporting configurablevertical resolution, according to one specific embodiment.

FIG. 8B illustrates selective scaling circuitry supporting configurablehorizontal and vertical resolution, according to another embodiment.

FIG. 9A-9H illustrate operation of the display when operating indifferent resolution modes, according to an embodiment.

FIGS. 10A and 10B are diagrams illustrating the use of eye tracking tocontrol a full resolution region of the display, according to anembodiment.

FIG. 11 is an interaction diagram for a virtual reality system that useseye tracking to control a full resolution region of the display,according to an embodiment.

FIG. 12 illustrates the hardware architecture of computing device,according to one embodiment.

The figures depict embodiments of the present disclosure for purposes ofillustration only. One skilled in the art will readily recognize fromthe following description that alternative embodiments of the structuresand methods illustrated herein may be employed without departing fromthe principles, or benefits touted, of the disclosure described herein.

DETAILED DESCRIPTION System Overview

FIG. 1 is a block diagram of a virtual reality (VR) system environment100, according to an embodiment. The system environment 100 shown byFIG. 1 comprises a VR headset 105 and a VR input interface 140 that areeach coupled to the VR console 110 through wired connections 190 and192. For example, the wired connection 190 can be a video cable couplingthe VR headset 105 to the VR console 110. In other embodiments thedevices may communicate wirelessly instead of through wired connections.

While FIG. 1 shows an example system 100 including one VR headset 105and one VR input interface 140, in other embodiments any number of thesecomponents may be included in the system 100. For example, there may bemultiple VR headsets 105 each having an associated VR input interface140, with each VR headset 105 and VR input interface 140 communicatingwith the VR console 110. In alternative configurations, different and/oradditional components may be included in the system environment 100.

The VR headset 105 is a head-mounted device that presents media to auser and is an example of a display device. Examples of media presentedby the VR head set include one or more images, video, audio, or somecombination thereof. In some embodiments, audio is presented via anexternal device (e.g., speakers and/or headphones) that receives audioinformation from the VR headset 105, the VR console 110, or both, andpresents audio data based on the audio information. An embodiment of theVR headset 105 is further described below in conjunction with FIGS. 2Aand 2B. The VR headset 105 may comprise one or more rigid bodies, whichmay be rigidly or non-rigidly coupled to each other together. A rigidcoupling between rigid bodies causes the coupled rigid bodies to act asa single rigid entity. In contrast, a non-rigid coupling between rigidbodies allows the rigid bodies to move relative to each other.

The VR headset 105 includes an electronic display 115, eye trackingsensor 118, and communication interface 125. The VR headset 105 mayinclude other components not shown in FIG. 100, such as position sensorsand location sensors (not shown). The interface 125 sends data to andreceives data from the virtual reality console via the wired connection190.

The electronic display 115 displays images to the user in accordancewith image data received from the VR console 110. In variousembodiments, the electronic display 115 may comprise a single electronicdisplay or multiple electronic displays (e.g., a display for each eye ofa user). Examples of the electronic display 115 include: an organiclight emitting diode (OLED) display, a liquid crystal display (LCD), orother types of displays.

The electronic display 115 includes a display screen having a matrix ofpixels organized into pixel columns and pixel rows. The electronicdisplay 115 also includes display circuitry that receives image datafrom the virtual reality console 110 and generates pixel driving signalsin order to produce visual images on the display screen from the imagedata.

In one embodiment, the electronic display 115 includes twice the numberof data lines and data drivers of a typical display. The increased datalines and connection of the data lines to the pixels allows the refreshrate of the electronic display 115 to be doubled in frequency. Thehigher refresh rates increase the realism of moving images shown on theelectronic display 115. Similarly, the refresh rate can be maintainedwhile increasing the time allowed per row to charge the pixelcapacitors.

In one embodiment, the electronic display 115 can be selectivelyconfigured to have a higher effective resolution in a section of thescreen that matches the direction of the user's gaze, while having alower effective resolution in other sections of the screen not beingviewed by a user. This reduces the required bandwidth needed to provideimage data from the virtual reality console 110 to the virtual realityheadset 105 via the wired connection 190 without any perceptible loss inimage quality.

Eye tracking sensor 118 tracks the gaze of a user's eye and generatesgaze data indicative of gaze direction of the user's eye. One example ofan eye tracking sensor 118 is a camera that captures infrared lightreflected off the pupil of the eye with an image sensor, and whichgenerates gaze data in the form of captured images. The gaze data isthen transmitted to the virtual reality console 110, where the imagesare processed by the eye tracking module 150 to extract gaze directionfrom changes in reflections. The gaze direction is then used toselectively adjust the region of the display 115 that is to have higherresolution. The higher resolution region is continuously moved to trackthe user's gaze direction. In another embodiment, the eye trackingmodule 150 may be located within the virtual reality headset 105 suchthat the gaze direction is determined within the headset 105 itself.Other examples of eye tracking sensors 118 are also possible, such aseye-attached tracking sensors and electric potential measurementsensors.

The VR input interface 140 is a device that allows a user to send actionrequests to the VR console 110. An action request is a request toperform a particular action. For example, an action request may be tostart or end an application or to perform a particular action within theapplication. The VR input interface 140 may include one or more inputdevices. Example input devices include: a keyboard, a mouse, a gamecontroller, or any other suitable device for receiving action requestsand communicating the received action requests to the VR console 110. Anaction request received by the VR input interface 140 is communicated tothe VR console 110, which performs an action corresponding to the actionrequest. In some embodiments, the VR input interface 140 may providehaptic feedback to the user in accordance with instructions receivedfrom the VR console 110. For example, haptic feedback is provided whenan action request is received, or the VR console 110 communicatesinstructions to the VR input interface 140 causing the VR inputinterface 140 to generate haptic feedback when the VR console 110performs an action.

The VR console 110 provides media to the VR headset 105 for presentationto the user in accordance with information received from one or more of:the VR headset 105, and the VR input interface 140. Examples of VRconsoles 110 include computers, video game consoles, and other computingdevices.

In the example shown in FIG. 1, the VR console 110 includes an interface142, an application store 145, an eye tracking module 150, and a virtualreality (VR) engine module 155. The interface 142 sends data to andreceives data (e.g. image data, gaze data) from the virtual realityheadset 105 via the wired connection 190.

The application store 145 stores one or more applications for executionby the VR console 110. An application is a group of instructions, thatwhen executed by a processor, generates content for presentation to theuser. Content generated by an application may be in response to inputsreceived from the user via movement of the HR headset 105 or the VRinterface device 140. Examples of applications include: gamingapplications, conferencing applications, video playback application, orother suitable applications.

The VR engine module 155 executes applications within the systemenvironment 100 and receives gaze direction information from the eyetracking module 150. Based on the received information, the VR engine155 determines how content images are to be processed and provided tothe VR headset 105.

In one embodiment, the VR engine 155 determines, from the user's gazedirection, which region of the display 105 should be high resolution inorder to match the user's gaze. For example, the VR engine 155 canestimate which pixels of the display 115 the gaze is focused on, and usethose pixels as the center of the high resolution region (e.g. fullresolution region). The VR engine 155 then generates resolutionconfiguration data that specifies the location of the reduced resolutionand full resolution regions of the display 115. This resolutionconfiguration data is provided to the VR headset 105 via interface 142so that the display 115 can be configured to support reduced and fullresolution regions. The VR engine 155 then generates and provides imagedata to the virtual reality headset 105 for display in the reduced andfull resolution versions. The location of the full resolution window isadjusted to match the user's gaze such that the portion of the display115 being viewed by the user always appears to be clear and sharp.

Additionally, the VR engine module 155 performs an action within anapplication executing on the VR console 110 in response to an actionrequest received from the VR input interface 140 and provides feedbackto the user that the action was performed. The provided feedback may bevisual or audible feedback via the VR headset 105 or haptic feedback viathe VR input interface 140.

FIG. 2A is a wire diagram of a virtual reality (VR) headset 105, inaccordance with an embodiment. The VR headset 105 includes a front rigidbody 205 and a band 210. The front rigid body 205 includes one or moreelectronic display elements of the electronic display 115 (not shown)and the eye tracking sensors 118 (not shown). The front rigid body 205includes a front side 220 a, a top side 220 b, a bottom side 220 c, aright side 220 d, and a left side 220 e.

FIG. 2B is a cross section of the front rigid body 205 of the embodimentof a VR headset 105 shown in FIG. 2A. The front rigid body 205 includesan electronic display 115, and an eye tracking sensor 118 that generatesgaze data indicative of the direction of the eye's 245 gaze. The eyetracking sensor 118 is pointed at the pupil 250 such that movements ofthe pupil 118 can be captured. Some components may not be shown in FIG.2B, such as an optical block between the eye 245 and display 115 thatbends the light from the display 115.

Dual Data Driver Display

FIG. 3 is an electronic display 115 with dual row drivers, according toan embodiment. The electronic display 115 includes an active matrixdisplay screen 310 and display circuitry 320. The display screen 310includes an active matrix of pixels P organized in pixel rows (R1-R4)and pixel columns. Although not shown in FIG. 3, generally each pixel Pincludes multiple sub-pixels producing red, green, and blue light andthere would be additional data lines DL connected to each of thesub-pixels.

The display screen 310 includes data lines DL and scan lines SLconnected to the pixels P. Data lines DL carry data voltages to thepixels P that represent target brightness levels of the pixels. Scanlines SL carry scan pulses to the pixels P that scan the data voltagesinto the pixels P. Scan lines SL may also be referred to as gate lines.Only 16 pixels P, 4 scan lines SL and 8 data lines DL are shown in FIG.3 for ease of illustration. However, the display screen 310 typicallyhas a larger number of pixels P (e.g. millions of pixels P), scan linesSL and data lines DL.

Referring briefly to FIG. 4, shown is a pixel P of the active matrixdisplay screen 310, according to an embodiment. Pixel P can representany of the pixels P from FIG. 3. The pixel P is an OLED pixel. The pixelP includes a scan transistor T1, a storage capacitor C, a drivingtransistor Td and an OLED D1. When a scan pulse is applied from the scanline SL to the gate of scan transistor T1, scan transistor T1 turns onand the data voltage on the data line DL is latched or scanned into thestorage capacitor C. The data voltage stored in capacitor C turns on thedriving transistor T2, which drives current through the OLED D1 inaccordance with the level of the data voltage and causes the OLED D1 toemit light. In other embodiments the pixel P may have a differentstructure that uses additional transistors and electrical componentsother than those shown in FIG. 4.

Referring back to FIG. 3, each data line DL is connected to only halfthe pixel rows (R1-R4). The data lines DL can be divided into twosubsets: odd data lines (DL-1, DL3, etc) and even data lines (DL-2,DL-4, etc). The two odd and even data lines alternate with each other.Odd data lines (DL-1, DL-3, etc) are connected only to odd pixel rows(R1, R3). The odd data lines (DL-1-DL3, etc) are not connected to evenpixel rows (R2, R4), and are therefore electrically isolated from theeven pixel rows (R2, R4). Even data lines (DL-2, DL-4, etc) areconnected only to even pixels rows (R2, R4) but not odd pixels rows (R2,R4), and are therefore electrically isolated from the even pixel rows(R2, R4).

In other words, each pixel column is driven by a pair of data lines DL,and the pixels P in the column are connected in alternating mannerbetween the pair of data lines DL. For example, data line DL-1 isconnected to the pixels P in the odd rows (e.g. SL-1, SL-3). Data lineDL-2 is only connected to the pixels P in the even rows (e.g. SL-2,SL-4).

The display screen 310 includes two data drivers and twice as many datalines DL as conventional displays because each data line DL is onlyconnected to half the pixels P in a column, such as the odd pixel rowsor the even pixel rows, but not both. By including twice as many datalines DL, the refresh rate of the display can be doubled because eachsubsequent pixel row can be scanned before the previous pixel row hascompleted its scanning. Alternatively, the scan time for each pixel rowcan be increased while maintaining the same refresh rate.

FIG. 3A is the display from FIG. 3 where only the odd pixel rows areillustrated, according to an embodiment. The even pixel rows are hiddenfor ease of explanation. Odd scan line SL-1 is connected to all of thepixels in one odd pixel row R1. Odd scan line SL-3 is connected to allof the pixels in another odd pixel row R3. The odd data lines (DL-1,DL-3, etc) are connected to all of the odd pixel rows (R1, R3), but arenot connected to any of the even pixel rows.

FIG. 3B is the display from FIG. 3 where only the even pixel rows areillustrated, according to an embodiment. The odd pixel rows are hiddenfor ease of explanation. Even scan line SL-2 is connected to all of thepixels in one even pixel row R2. Even scan line SL-4 is connected to allof the pixels in another even pixel row R4. The even data lines (DL-2,DL-4, etc) are connected to all of the even pixel rows (R2, R4), but arenot connected to any of the odd pixel rows.

Referring back to FIG. 3, the display circuitry 320 includes a timingcontroller 330, an odd row data driver 350, an even row data driver 352and a scan driver 340. The timing controller 330, odd row data driver350, even row data driver 352, and scan driver 340 may all reside on asingle integrated circuit (IC), or on separate ICs. In some embodimentsthe scan driver 340 may be fabricated with thin film transistors and beseparate from the other circuits. In one embodiment, odd row data driver350 and even row data driver 352 are located on opposite sides of thedisplay screen 310. Odd row data driver 350 is located at the top of thedisplay screen, and even row data driver 352 is located on the bottomside of the display screen 310.

The timing controller 330 receives image data 370 and allocates rows ofthe image data 370 between the odd data driver 350 and even data driver352. Odd rows of image data 372 are delivered to the odd data driver450. Even rows of image data 374 are delivered to the even data driver352. The odd row data driver 350 converts the image data 372 into datavoltages that are driven onto the data lines DL connected to the oddpixel rows (R1, R3). The even row data driver 352 converts the imagedata 374 into data voltages that are driven onto the data lines DLconnected to the even pixel rows (R2, R4).

The timing controller 330 also provides gate timing control signals 376to control the operation of the scan driver 340. The scan driver 340generates scan pulses that are driven onto the scan lines SL. Each scanpulse scans in the data voltages to a pixel row. The pixels of a pixelrow hold the data voltages in their respective storage capacitors.

Referring now to FIG. 5, illustrated is a timing diagram illustratingoperation of the scan driver 340 and data drivers 350 and 352, accordingto an embodiment. The timing diagram includes signal waveforms for scanlines SL-1 through SL-4, and also for data lines DL-1 and DL2.

Data voltages d1 and d3 are driven onto data line DL-1 at differenttimes. Scan pulse sc1 scans data voltage d1 into a pixel P in the firstpixel row R1. Scan pulse sc3 scans data voltage d3 into a pixel P of thethird pixel row R3.

Data voltages d2 and d4 are driven onto data line DL-2 at differenttimes. Scan pulse sc2 scans data voltage d2 into a pixel P in the secondpixel row R2. Scan pulse sc4 scans a data voltage d4 into a pixel P ofthe fourth pixel row R4.

Scan pulses sc1-sc4 are driven sequentially onto the scan lines SL. Eachscan pulse overlaps with a previous scan pulse and next scan pulse intime. For example, scan pulse sc2 overlaps with scan pulse sc1 and scanpulse sc3. The scanning of each even pixel row thus overlaps with thescanning of each odd pixel row. Each pixel row can begin scanning beforea previous pixel row has completed scanning. This scanning overlapallows the refresh rate of the display to be increased because thescanning of one row does not need to be completed before scanning of thenext row begins. Similarly, the refresh rate can be maintained whileincreasing the time allowed per row to charge the pixel capacitors.

Configurable Resolution in Dual Driver Display

FIG. 6A is a diagram illustrating pixels of an electronic display 115,according to an embodiment. The display screen has a fixed nativeresolution of 1080×1080 (i.e. 1080 pixels wide, 1080 pixels tall). Toachieve the best image quality, a frame of image data provided to thevirtual reality headset 105 should match the native resolution of thedisplay screen. However, transferring a video stream to the virtualreality headset 105 in a resolution that matches the native resolutionof the display screen 310 can consume a large amount of bandwidth thatexceeds the limits of the wired connection 190. In one embodiment, theelectronic display 115 uses full resolution image frame data for oneportion of the display screen, and uses reduced resolution image framedata for another portion of the display screen, thereby reducing thedata bandwidth requirements of the wired connection 190.

FIG. 6B is a diagram illustrating a display screen of a display 115 withconfigurable effective resolution. The display 115 can be operated in amanner that causes it to have different effective resolutions indifferent regions of the display 115. Effective resolution may also bereferred to herein as a supported resolution. The display 115 uses fullresolution image data to display a full resolution image in one portionof the display, resulting in a full resolution region 610. The displayuses partial resolution image data to display a partial resolution imagein another portion of the display, resulting in a reduced resolutionregion 620.

The full resolution region 610 is shown as a window within andsurrounded by the reduced resolution region 620. Image data 370Bprovided for the full resolution region 610 matches the nativeresolution of the full resolution region 610 and can be directly appliedto the display screen 310 without upscaling. For example, the fullresolution region 610 can have a native resolution of 400×400. It has aneffective resolution of 400×400 because the image displayed in thatregion is generated from image frame data 370B having 400×400resolution.

Image frame data 370A provided for the reduced resolution region 620 islower than the native resolution of the reduced resolution region 620.The driver circuit 320 receives the reduced resolution image data 370Aand upscales the image data before applying the upscaled image data tothe display screen. For example, the reduced resolution region 620 canhave a native resolution of 1080×1080. It has an effective resolution of540×540 because the image displayed in that region is generated fromimage frame data 370A having 540×540 resolution. The image frame data370A is upscaled by 2× in both the horizontal and vertical directionsbefore it is displayed in the reduced resolution region 620.

In other embodiments the full resolution region 610 and reducedresolution region 620 may be different in size and shape. For example,the upper pixel rows of the display 115 may be the full resolutionregion while the lower pixel rows of the display 115 is the reducedresolution region. The sizes of the regions can be configured in anymanner from the entire panel down to a single color in a row.Beneficially, operating only a portion of the display 115 in fullresolution reduces the required bandwidth for image data transferredfrom the virtual reality console 110 to the virtual reality headset 105.

FIG. 7 illustrates a timing controller 330 and data drivers 350 and 352supporting configurable resolution, according to an embodiment. Thetiming controller 330 is shown with a resolution register 705 andscaling circuitry 710. In one embodiment, the resolution register 705can be a portion of a memory dedicated to storing configuration data, orcan be a dedicated circuit for storing resolution configuration data.

The resolution register 705 stores resolution configuration data 706describing regions of the display 115 that are to be operated in fullresolution and regions of the display 115 that are to operate in reducedresolution. For example, the resolution configuration data 706 mayinclude row/column coordinates of the boundaries of the full resolutionregion 610 and row/column coordinates of the boundaries of the reducedresolution region 620. The resolution configuration data 706 may beprovided by the VR console 110 and then stored in the resolutionregister 705. The resolution configuration data 706 may also includeinformation describing whether the resolution is being reduced in avertical direction, horizontal direction, or both. The resolutionconfiguration data 706 may also include information describing an amountof upscaling (e.g. 2×, 4×, none) that should be applied in each regionof the display.

The selective scaling circuitry 710 receives image data 370 provided bythe VR console 110, and also reads the resolution configuration data 706from the resolution register 705. For a single image frame, the imagedata 370 can include both reduced resolution image data 370A and fullresolution image data 370B. The scaling circuitry 710 uses theresolution configuration data 706 in determining which portions of theimage data 370 are reduced resolution image data 370A intended for thereduced resolution region and which are full resolution image data 370Bintended for the full resolution region. For portions of the image data370 intended for the full resolution region 610 (i.e. full resolutionimage data 370A), the data does not need upscaling and is directlypassed on to the odd row data driver or even row data driver 352. Forportions of the image data 370 intended for the low resolution region(i.e. reduced resolution image data 370A), the scaling circuitry 720upscales the image data 370 in the vertical direction, horizontaldirection, or both.

The upscaling allows low resolution image data 370A to properly fill allof the pixels in the reduced resolution region 620. Typically upscalinginvolves duplicating image pixel data without using interpolation.Duplicating image pixel data in the vertical direction can includeproviding the same row of image data 370 to both the odd row data driver350 and even row data driver 352, which results in the same image beingdisplayed in two adjacent pixel rows. Duplicating image pixel data inthe horizontal direction can include duplicating image pixel data acrosscolumns such that the same image pixel data is provided to adjacentpixels in a row. In other embodiments, the upscaling can includeinterpolation between adjacent pixels.

FIG. 8A illustrates selective scaling circuitry 710 supportingconfigurable vertical resolution, according to one specific embodiment.The selective scaling circuitry 710 includes a de-multiplexer 804, rowbuffers 806 and 808, routing circuit 810 and control circuit 812. Thisembodiment of the selective scaling circuitry 710 can duplicate rows ofimage data and provide the duplicated rows to both the odd row datadriver 350 and even row data driver 352, which allows for adjustment ofvertical resolution. The circuitry shown in FIG. 8 is just one exampleof circuitry for adjusting vertical resolution, and in other embodimentsother types of circuitry are possible.

De-multiplexer 804 receives the image data 370 and directs rows of theimage data 370 to row buffer 806 or row buffer 808. De-multiplexer 804is controlled by multiplexer control signal 802. Multiplexer controlsignal 802 switches states under control of the image data row clock(i.e. with each image data row) such that rows of image data are storedin alternating manner between row buffer 806 and row buffer 808. Routingcircuit 810 selectively directs rows of image data stored in row buffer806 and 808 to odd row data driver 350 or even row data driver 352.

Control circuit 812 generates one or more routing control signals 813that control the routing of rows through the routing circuit 810.Control circuit 812 generally changes the configuration of the routingcircuit 810 at a rate that matches the scan frequency of the display.The register configuration data 706 sets at which row to switch fromreduced resolution mode to full resolution mode and back. Thus, thestate of the routing control signals 813 is controlled depending onwhether an incoming row of the image data 370 is supposed to be handledin reduced resolution or full resolution mode, as indicated by theresolution configuration data 706 read from the resolution register 705.This is explained in greater detail by reference to FIG. 9A-9H.

FIG. 9A-9H illustrate operation of the display 115 supporting differentresolutions for different display regions, according to an embodiment.In FIG. 9A-9H, the reduced resolution region of the display occupiespixel rows 1-4 and that the full resolution region of the displayoccupies pixel rows 5-7. FIG. 9A-9E illustrate operation of the displaywhen operating in reduced resolution mode for the first four pixel rowsof the display, which is the reduced resolution region. FIG. 9F-9Hillustrate operation of the display when operating in full resolutionmode for pixel rows five through seven, which is the full resolutionregion.

Initially the display is in reduced region mode of operation for pixelrows one through four where pixel duplication is needed. In FIG. 9A, animage data row IDR1 is received and stored into row buffer 806.

In FIG. 9B, an image data row IDR2 is received and stored into rowbuffer 808. At the same time, image data row IDR1 is routed from rowbuffer 806 to odd row data driver 350 and scanned into the first pixelrow of the display screen 310.

In FIG. 9C, while image data row IDR2 is still being stored into rowbuffer 808, image data row IDR1 is now routed from row buffer 806 toeven row data driver 352 and scanned into the second pixel row of thedisplay screen 310.

In FIG. 9D, an image data row IDR3 is received and stored into rowbuffer 806. At the same time, image data row IDR2 is routed from rowbuffer 808 to the odd row data driver 350 and scanned into the thirdpixel row of the display screen 310.

In FIG. 9E, while image data row IDR2 is still being stored into rowbuffer 806, image data row IDR2 is now routed from row buffer 808 to theeven row data driver 352 and scanned into the fourth pixel row of thedisplay screen 310.

The display now switches to full resolution mode of operation for pixelrows five through seven where pixel duplication is not needed. In FIG.9F, an image data row IDR4 is received and stored into row buffer 808.At the same time, image data row IDR3 is routed from row buffer 806 tothe odd row data driver 350 and scanned into the fifth pixel row of thedisplay screen 310.

In FIG. 9G, an image data row IDR5 is received and stored into rowbuffer 806. At the same time, image data row IDR4 is routed from rowbuffer 808 to the even row data driver 352 and scanned into the sixthpixel row of the display screen 310.

In FIG. 9H, an image data row IDR6 is received and stored into rowbuffer 808. At the same time, image data row IDR5 is routed from rowbuffer 806 to the odd row data driver 350 and scanned into the seventhpixel row of the display screen 310.

It should be noted that, in reduced resolution mode, the incoming imagerow clock is half the speed of the scan clock scanning the rows into thedisplay screen. In full resolution mode, the incoming row image rowclock is the same as the scan clock scanning the rows into the displayscreen.

FIG. 8B illustrates selective scaling circuitry 710 supportingconfigurable horizontal and vertical resolution, according to anotherembodiment. The selective scaling circuitry 710 of FIG. 8B is similar tothe selective scaling circuitry 710 of FIG. 8A, but now includes acolumn upscaling circuit 820, which allows for adjustment of effectivehorizontal resolution. The column upscaling circuit 820 can selectivelyduplicate pixels of the image data 370 across pixel columns so thatreduced resolution image data can be upscaled to the native resolutionof the display screen.

Control circuit 812 generates one or more control signals 816 thatcontrol whether the column upscaler 820 should upscale the incoming data370. When the register configuration data indicates that incoming datais intended for the reduced resolution region 620 of the screen, thecontrol circuit 812 generates the control signal 816 in one state (e.g.logic high) to enable horizontal upscaling. When the registerconfiguration data indicates that incoming data is intended for thereduced resolution region 610 of the screen, the control circuit 812generates the control signal 816 in another state (e.g. logic low) todisable horizontal upscaling. Thus, the state of the control signals 816is controlled depending on whether an incoming portion of the image data370 is supposed to be handled in reduced resolution or full resolutionmode, as indicated by the resolution configuration data read from theresolution register 705.

The column upscaler 820 outputs image data 822 that may or may not behorizontally upscaled, depending on whether upscaling was needed. In anycase, a row of the image data 822 now includes data for a number ofpixels that matches a number of pixels in a pixel row of the displayscreen 310. De-multiplexer 804 receives the image data 370 and directsrows of the image data 370 to row buffer 806 or row buffer 808.

In another embodiment, different amounts of upscaling may be applied todifferent portions of the image data 370. For example, a high amount ofupscaling (e.g. 4×) may be applied to image data intended for onedisplay region, while a low amount of upscaling (e.g. 2×, no upscaling)may be applied to image data intended for another display region.

Eye Tracking Control of Display Resolution

FIGS. 10A and 10B are diagrams illustrating the use of eye tracking tocontrol a full resolution region 710 of the display 115, according to anembodiment. FIG. 10A includes an eye 245 having a gaze 1000 directed toa portion of the display 115. The display 115 is controlled such thatthe full resolution region 610 tracks the user's gaze 1000. For example,in FIG. 10B, the gaze direction 1000 has moved to the left. As a result,the full resolution region 610 is moved to the left to match the user'snew gaze 1000.

In a human eye, the foveal region of the retina is the only part of theretina that permits 100% visual acuity. In a VR headset 105 where thedisplay 115 is placed close to the user's eye 245, only a small portionof the display 100 is viewed by foveal region anyways while the rest ofthe display 115 is viewed by other parts of the retina. Thus, to thehuman eye, there is no loss in clarity if the portion of the displayoutside of the foveal region is not in full resolution.

FIG. 11 is an interaction diagram for using eye tracking to control afull resolution region of the display 115, according to an embodiment.The VR headset 105 tracks the eye and generates gaze data indicative ofa gaze direction of the user's eye. The VR headset 105 transmits 1105the gaze data to the VR console 110. The VR console 110 receives thegaze data and analyzes the gaze data to determine 1115 the user's gazedirection.

The VR console 110 determines, from the gaze direction, the region ofthe display that is to be full resolution and the region that is to havereduced resolution. The VR console 110 attempts to match the fullresolution region with the gaze direction of the user in order to trackthe user's eye movements. The VR console 110 transmits 1125 resolutionconfiguration data describing the adjusted location of the fullresolution region, the adjusted location of the reduced resolutionregion or both sets of locations to the VR headset. The VR headset 105receives the resolution configuration data and stores 1130 theresolution configuration data in a resolution register. In oneembodiment, steps 1120, 1125, and 1130 result are steps involved in theadjustment of the location of the full resolution region 620.

The VR console 110 then generates 1135 image data for display at the VRheadset 105. In each image frame, part of the image data is for thereduced resolution region 620 of the display, and part of the image datais for the full resolution region 610 of the display. The VR console 110transmits 1140 the image data to the VR headset 105. The VR headset 105processes 1145 the image data in accordance with the resolutionconfiguration data. The processing includes upscaling portions of theimage data corresponding to the reduced resolution region 620 of thedisplay, and not upscaling portions of the image data corresponding tothe full resolution region 610 of the display. The VR headset 105 thendisplays 1150 an image that has a full resolution region 610 and apartial resolution region 620 by providing the image data to the datadrivers 350 and 352.

The process also repeat s1155 continuously at periodic intervals so thatthe full resolution region 610 is periodically adjusted to track theuser's gaze.

Other Considerations

FIG. 12 illustrates the hardware architecture of computing device 1200,according to one embodiment. In some embodiments, the computing device1200 may be used as VR console 110. The computing device includescomponents such as a processor 1202, a memory 1203, a storage module1204, an input module (e.g., keyboard, mouse, and the like) 1206, adisplay module 1207 and a communication interface 1205, exchanging dataand control signals with one another through a bus 1201. The storagemodule 1204 is implemented as one or more non-transitory computerreadable storage media (e.g., hard disk drive), and stores softwareinstructions 1240 that are executed by the processor 1202 in conjunctionwith the memory 1203 to implement the operations of the eye trackingmodule 150, virtual reality engine module 155, or other operationsdescribed herein. Operating system software and other applicationsoftware may also be stored in the storage module 1204 to run on theprocessor 1202.

The foregoing description of the embodiments of the disclosure has beenpresented for the purpose of illustration; it is not intended to beexhaustive or to limit the disclosure to the precise forms disclosed.Persons skilled in the relevant art can appreciate that manymodifications and variations are possible in light of the abovedisclosure.

The language used in the specification has been principally selected forreadability and instructional purposes, and it may not have beenselected to delineate or circumscribe the inventive subject matter. Itis therefore intended that the scope of the disclosure be limited not bythis detailed description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosed embodiments areintended to be illustrative, but not limiting, of the scope of thedisclosure, which is set forth in the following claims.

What is claimed is:
 1. A display device comprising: a display screencomprising a plurality of pixels organized into pixel columns and pixelrows; and a resolution circuit to store resolution configuration dataindicative of a location of a first region of the display screenoperating in reduced resolution and indicative of a location of a secondregion of the display screen operating in full resolution; and selectivescaling circuit to receive image data and to process the image databased on the resolution configuration data, the selective scalingcircuit upscaling a first portion of the image data for the first regionof the display screen and not upscaling a second portion of the imagedata for the second region of the display screen.
 2. The display deviceof claim 1, wherein the upscaling comprising duplicating the firstportion of the image data across one or more of the pixel columns. 3.The display device of claim 1, wherein the upscaling comprisesduplicating the first portion of the image data across one or more ofthe pixel rows.
 4. The display device of claim 1, wherein the displaydevice comprises: a first data driver for a first subset of the pixelrows of the display screen; and a second data driver for a second subsetof the pixels rows of the display screen, wherein the selective scalingcircuit upscales the image data by providing a row of image data to boththe first data driver and the second data driver.
 5. The display deviceof claim 4, wherein the selective scaling circuit includes: a row bufferto store the row of image data; and a routing circuit to route the rowof image to both the first data driver and the second data driver. 6.The display device of claim 1, further comprising: a timing controller,wherein the resolution circuit and selective scaling circuit are part ofthe timing controller.
 7. The display device of claim 1, wherein thedisplay device is a virtual reality headset that comprises: an interfaceto a virtual reality console, the image data received from the virtualreality console via the interface.
 8. The display device of claim 1,wherein the image data is received from the virtual reality console viaa wired connection between the virtual reality console and the virtualreality headset.
 9. The display device of claim 7, wherein the interfacereceives the resolution configuration data from the virtual realityconsole via the interface.
 10. The display device of claim 1, whereinthe first region of the display screen has a first native resolution andoperates in reduced resolution by having an effective resolution lowerthan the first native resolution, and wherein the second region of thedisplay screen has a second native resolution and operates in fullresolution by having an effective resolution that is same as the secondnative resolution.
 11. The display device of claim 1, wherein the secondregion of the display screen is surrounded by the first region of thedisplay screen.
 12. A method of operation in a display device having adisplay screen, the method comprising: storing resolution configurationdata indicative of a location of a first region of the display screenoperating in reduced resolution and indicative of a location of a secondregion of the display screen operating in full resolution; and receivingimage data and processing the image data based on the resolutionconfiguration data, the processing comprising upscaling a first portionof the image data for the first region of the display screen and notupscaling a second portion of the image data for the second region ofthe display screen.
 13. The method of claim 12, wherein the upscalingcomprising duplicating the first portion of the image data across one ormore pixel columns of the display screen.
 14. The method of claim 12,wherein the upscaling comprises duplicating the first portion of theimage data across one or more pixel columns of the display screen. 15.The method of claim 12, wherein the display device comprises a firstdata driver for a first subset of pixel rows of the display screen, anda second data driver for a second subset of pixels rows of the displayscreen, and upscaling the image data comprises: providing a row of imagedata to both the first data driver and the second data driver.
 16. Themethod of claim 15, wherein providing a row of image data to both thefirst data driver and the second data driver comprises storing a row ofimage data in a row buffer, and routing the row of image data from thebuffer to both the first data driver and the second data driver.
 17. Themethod of claim 12, wherein the resolution configuration data is storedin a virtual reality headset, and the image data is received at thevirtual reality headset from a virtual reality console
 18. The method ofclaim 12, wherein the image data is received from the virtual realityconsole via a wired connection between the virtual reality console andthe virtual reality headset.
 19. The method of claim 18, furthercomprising: receiving the resolution configuration data from the virtualreality console via the interface.
 20. The method of claim 12, whereinthe first region of the display screen has a first native resolution andoperates in reduced resolution by having an effective resolution lowerthan the first native resolution, and wherein the second region of thedisplay screen has a second native resolution and operates in fullresolution by having an effective resolution that is same as the secondnative resolution.